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Abstract 

We study the robust Nash equilibrium (RNE) for a class of games in communications systems and 
networks where the impact of users on each other is an additive function of their strategies. Each user 
measures this impact, which may be corrupted by uncertainty in feedback delays, estimation errors, 
movements of users, etc. To study the outcome of the game in which such uncertainties are encountered, 
we utilize the worst-case robust optimization theory. The existence and uniqueness conditions of RNE 
are derived using finite-dimensions variational inequalities. To describe the effect of uncertainty on the 
performance of the system, we use two criteria measured at the RNE and at the equilibrium of the game 
without uncertainty. The first is the difference between the respective social utility of users and, the 
second is the differences between the strategies of users at their respective equilibria. These differences 
are obtained for the case of a unique NE and multiple NEs. To reach the RNE, we propose a distributed 
algorithm based on the proximal response map and derive the conditions for its convergence. Simulations 
of the power control game in interference channels, and Jackson networks validate our analysis. 

Index Terms 

Resource allocation, robust game theory, variational inequality, worst-case robust optimization. 

I. Introduction 

Distributed designs for multi-user communications networks and systems have been extensively used 
during the past decade to implement low-cost, scalable, and limited-message-passing networks. In doing 
so, transmitter and receiver pairs with local information determine their transmission strategies in an 
autonomous manner. To deploy such designs, it is essential to know whether they converge to a (preferably 
unique) equilibrium, and evaluate their performances at the emerging equilibrium/equilibria. 

Strategic non-cooperative game theory provides an appropriate framework for analyzing and designing 
such environments where users (i.e., transmitter-receiver pairs) are rational and self-interested players 
that aim to maximize their own utilities by choosing their transmission strategies. The notion of Nash 
equilibrium (NE), at which no user can attain a higher utility by unilaterally changing its strategy, is 
frequently used to analyze the equilibrium point of non-cooperative games. To derive the conditions for 
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NE's existence and uniqueness, different approaches such as fixed point theory, contraction mapping and 
variational inequalities (VI) Hl-lEl have been widely applied in both wired and wireless communication 
networks, including applications to flow and congestion control, network routing, and power control in 
interference channels PI- llTTl . 

However, there are numerous sources of uncertainty in measured parameter values of communication 
systems and networks such as joining or leaving new users, delays in the feedback channel, estimation 
errors and channel variations. Therefore, obtaining accurate values of users' interactions may not be 
practical, and considering uncertainty and proposing a robust approach are essential in designing reliable 
communications systems and networks. 

To make a NE robust against uncertainties, two distinct approaches have been proposed in the literature: 
the Bayesian approach where the statistics of uncertain parameters are considered and the utility of each 
user is probabilistically guaranteed, and the worst-case approach where a deterministic closed region, 
called the uncertainty region, is considered for the distance between the exact and the estimated values 
of uncertain parameters, and the utility of each user is guaranteed for any realization of uncertainty within 
the uncertainty region ||T2| - ||T5| . 

Both of these approaches have been applied to the power allocation problem in spectrum sharing 
environments and cognitive radio networks ||T3l . llT4l . ||T6l . ifTTl to study the conditions for NE's existence 
and uniqueness, where the uncertain parameters are interference levels and channel gains. However, to 
incorporate robustness in communications systems and networks, there exist multiple challenges such as: 
1) How to implement robustness in a wider class of problems in communication systems? 2) How to 
derive the conditions for existence and uniqueness of the robust NE (RNE)? 3) What is the impact of 
considering uncertainties on the system's performance at its equilibrium compared to that of the case 
with no uncertainty? 4) How to design a distributed algorithm for reaching the robust equilibrium? 

In this paper, we aim to answer the above questions using the worst-case robust optimization. In 
doing so, we consider a general class of games where the impact of users on each other is an additive 
function of their actions, which causes couplings between users. We refer to this class of game as the 
additively coupled games (ACGs). In the ACG, we consider that the users' observations of such impacts 
are uncertain due to variations in system parameters and changes in other users' strategies. Via the worst- 
case approach, we assume that uncertain observations by each user are bounded in the uncertainty region, 
and each user aims to maximize its utility for the worst-case condition of error. We refer to an ACG that 
considers uncertainty as a robust ACG (RACG), and an ACG that does not consider uncertainty as the 
nominal ACG (NACG). To study the conditions for existence and uniqueness of the RNE, we apply VI 
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||2l, and show that with bounded and convex uncertainty, the RNE always exists. We also show that the 
RNE is a perturbed solution of VI, and derive the condition for RNE's uniqueness based on the condition 
for NE's uniqueness. 

Furthermore, we compare the performance of the system at the RNE with that at the NE in terms of 
two measures: 1) the difference between the users' strategies at the RNE and the NE, 2) the difference 
between the social utility at the RNE and at the NE. When the RNE is unique, we derive the upper bound 
for the difference between social utilities at the RNE and at the NE, and show that the social utility at the 
RNE is always less than that at the NE. However, obtaining these two measures is not straightforward 
when the NE is not unique. In this case, we demonstrate a condition in which the social utility at a RNE 
is higher than that at the corresponding NE. Finally, we apply the proximal response map to propose a 
distributed algorithm for reaching the RNE, and derive the conditions for its convergence. 

The rest of this paper is organized as follows. In Section II, we summarize the system model of 
the NACG. In Section III, we introduce the RACG and its RNE. Section IV covers the existence and 
uniqueness conditions if the RNE. In Section V, we show that when the utility function is logarithmic, 
the RNE can be obtained via affine VI (AW), and its uniqueness condition is simplified. In Section VI, 
we propose distributed algorithm for reaching RNE. In Section VII, we discuss the effects of robustness 
for the case of multiple Nash equilibria, followed by Section VIII, where we provide simulation results 
to illustrate our analytical developments for the power allocation problem and for the Jackson networks. 
Finally, conclusions are drawn in Section IX. 

II. System Model 

Consider a set of communication resources divided into K orthogonal dimensions, e.g., frequency 
bands, time slots, and routes, which are shared between a set of users denoted by TV^ = {1, • • • , N}, where 
each user consists of a transmitter and a receiver. We assume that users do not cooperate with each other, 
and formulate the resource allocation problem as a strategic non-cooperative game Q = {M, {vn)n£N^ -4}, 
where N is the set of players (users) in the game, A = HneAA is the joint strategy space of the game, 
and An Q IR^^ is the strategy space of user n in which the strategy of each user is limited in each 
dimension. The sum of strategies of each user over all dimensions is bounded, i.e., 

K 

An = {a„ = {al ■ ■ ■ , a^)|a^ G Kfc", a^^^l and J] ^ < (D 

k=l 

where a^^^ and a™^^ is the minimum and the maximum transmission strategy of each user in each 
dimension and a^^^ is the bound on the sum of strategies of user n over all dimensions, e.g., the maximum 
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transmit power of each user. The function Vn{si) : A ^ M. is the utility function of user n and depends 
on the chosen strategy vector of all users a = [ai, • • • ,aAr], where a„ G An is the action of user n. The 
vector of actions of all users except user n is denoted by a_„ G A-n where A-n = YimeAf m^n ■^rn is 
the strategy space of all users except user n. 

In a non-cooperative strategic game, each user aims to maximize its own utility subject to its strategy 
space as 

max r;„(a), Vn G A/". (2) 

a„6»4„ 

which is the optimization problem of each user in the game. Let us assume that the utility of each user 
is a function of its action and the impact of the others users' actions over all dimensions, i.e., 

K 

t;„(a„,f„,(a_„,x„)) = J]] u^(a^, /^(a_„,x„)) (3) 

k=l 

where f„(a_„,x„) = [/^(a_„,x„), /^(a_„,x„)] is the 1 x vector of the additive impact of other 
users on user n with the following elements 

fni^-n,'^n) = ^m^nm + ^n) (4) 

where x„ = [x„i, • • • ,x„(„_i),x„(„_|_i), • • • ,x„7V;yn] is the vector of system's parameters for user n, in 
which Xnm = [a^nmi ' ' ' '^mn]' ^^'^ ^nm represcnts the system's parameters between user n and user m 
in dimension k, e.g., the channel gain between user n and user m in sub-channel k; y„ = [y,^, • • • , y^] is 
the vector of the effect of system on user n, e.g., noise in sub-channels for user n, and is related to the 
A;* dimension. Assuming f^(a_„,x„) as a linear function is very practical in communication networks. 
For example, the interference in each receiver is a linear and additive function of the actions of other 
users and channel gains plus noise. We also assume that Al) The utility function of each user is an 
increasing, twice differentiable, and concave function with respect to a„ and has bounded gradients; A2) 
The utility function of each user is a decreasing, twice differentiable, and convex function with respect 
to f„(a_„,x„); A3) The utility function of each user is twice differentiable over a„, and f„(a_„,x„). 
Note that Al is a typical utility function in communications networks [|T8|; A2 is a practical assumption 
for sharing resources between non-cooperative users [0; and A3 indicates that the utility function is 
continuously differentiable with respect to a„ and f„(a_„,x„). As such, the above assumptions A1-A3 
are typical in communications systems and networks. 

Interactions between users are studied at the NE, which corresponds to the strategy profile a* = 
(aj, • • • ,a^) such that for any other strategy profile, we have lH] 

i;„(a*,f„(al„,x„)) > 7;„(a„,f„(al„,x„)), n G A/". (5) 
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In what follows, we denote the achieved utility of user n at the NE by and the social utility at the NE 
by V* = X]^=i ^n' derive the conditions for NE's existence and uniqueness conditions via reformulating 
NE through VI, and show that in this way, the NE and the RNE can be analyzed similarly. 
Remark 1. Consider J'(a) = (7'„(a))^^]^, where 

Tn{a) = (-Va„-Un(a„,fn(a_n,Xn)), (6) 

where Va„Ur!.(an, fn(a-n, x„)) denotes the column gradient vector of t'„(an,f«(a_n,x.„)) with respect to 
a„. The NE of Q can be obtained by solving VI{A,J-') (Proposition 1.4.2 in |]2l) as 

(a-a*)J-(a*) > 0,Va G A (7) 

Since t;„(a„,f„(a_„,x„)) is a continuous and concave function with respect to a„ G An, is a 

continuous map. From ([T|), the set A is convex and compact. Therefore, the solution set of VI{A, T) is 
nonempty and compact (Theorem 2.2.1 in ||2l). Consequently, the NE of ACG exists. 
Remark 2. Let us consider the following definitions of mapping ^(a), 

Q„(a) = smallest eigenvalue of - 7;„(an, fn(a-„, x.„)) =^ oi^''^ = inf a„(a), \/n £ M (8) 
/3nm(a) = II - Va„a„^^n(an,fn(a-n,X„))||, Vn / m =^ ^ sup /3„ (a) , Vn G (9) 

where f„(a„, f„(a_„, x„)) and Va„a„,t^n(an, fn(a-n, x„)) are the K x K Jacobian matrices of J-'n(a) 
with respect to a„ and am, respectively. Now, consider the N x N matrix T whose elements are 

a™" if m = n 
-/3-- if m^n. 

When T is a P-matrix, the mapping /"(a) is strictly monotone and the NE is unique (Theorem 12.5 in 

my 

This setup is applicable to some important problems in communications systems and networks, such 
as the additively coupled sum constrained game Q, which can be used to formulate, e.g., power control 
in interference channels, and the Jackson network. These two systems are chosen to illustrate the validity 
of our approach and analysis. Table U contains the parameters of the power control, and the Jackson 
network games. 

The power control in interference channels can be formulated by a ACG, where each player, consisting 
of a transmitter and receiver pair, competes with other players to maximize its total data rate over K 
distinct sub-channels. The strategy of each user is its transmit power in K sub-channels, where is 
the direct channel gain between the transmitter and receiver pair n, and /i„„^ = -p^ and = j^r- are 
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the nomialized interference channel gain between transmitter m and receiver n, and the normalized noise 
power in sub-channel k, respectively. For the Jackson network in Table U arriving packets to node n are 
split into /C = [1, • • • ,K] traffic classes, and the input rate and service rate for class k are tp^ and /uj:^, 
respectively. Here, tp^ is the strategy of player 7i in dimension k. The total rate is subject to the minimum 
rate constraint, i.e., X^a^i ^ ^n'"- ^ packet of class k completing service at node m is routed to 
node n with probability r^^, or exit the network with probability r^^Q = 1 — J2n=i '''nm- I^i this scenario, 
we denote [B!']nm = r^m, ®^ = (1 — R^)~^, and = [Q'^]nm- It can be shown that the user's utility 
for minimizing M/M/1 queueing delay can be expressed by dn{^) = ^k=i k_\^t^^ — i — w where 
^ = [^1, • • • , ^at], and = [V'n) ■ ■ ■ ; '4'n] ^ J\f. The optimization problem can be rewritten by 
maximizing J2k=i ~ Sm=i ^nm^m subject to the minimum data rate constraint for each user. 

III. Robust Games 

As stated earlier, users may encounter different sources of uncertainty caused by variations in a_„ 
and/or x„m, which cause variations in the utility function of each user, and prevent users from attaining 
their expected performance. To deal with such issues, we assume that all uncertainties for a given user 
can be modeled by variations in the user's observation f„(a„n,x„), i.e., 

fn(3— rijX^) = fn(3-n) Xn) + fn (^-nj Xn) , (10) 

where f„(a_„,x„) = [/^(a_„,x„), • • • , /^(a_„,x„)], f„(a_„,x„) = [/^(a_„,x„), • • • , /^(a_„,Xn)], 
and f„(a_„,x„) = [/^(a_„,x„), • • • ,/^(a_„,x„)] are the actual observation, the nominal observation, 
and the error in observation of user n, respectively. In the worst-case robust optimization theory, uncer- 
tainties are assumed to be bounded to the uncertainty region, stated by 

K„(a_„) = {f„(a )\\p<en} ,VneAA (11) 

where || t ||p= ^ (X^i^i denotes the linear norm with order p > 1. In communication and network 
systems, the ellipsoid region, i.e., p = 2, has been commonly used to model uncertainty lITSl . |[T9l . ll20l . 
We also use the norm with p = 2 in our robust game, and denote the uncertainty region by 3fJ„(a_„) so 
as to indicate that it is an additive function of the actions of other users and system parameters, i.e., it 
is not a fix region. 

The effect of uncertainty in f„(a_„,x.„) is highlighted by a new variable in the utility function of each 
user as 

K 

u„(a„,f„(a_„,x„)) = ^n^(a^,/^(a_„,x„)), Vn G A/" (12) 

k=l 
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in such a way that 

(a_„,x„)) = 'u„(a„,f„(a_„,x„))|e„=o, V?i e A/" (13) 

The objective of the worst-case approach is to find the optimal strategy for each user that optimizes 
its utility under the worst condition of error in the uncertainty region. In this approach, from A2, the 
optimization problem of each user can be formulated as lIlTI 

u„ = max ^ min ^^(an, f„(a_„,x„)), (14) 

a„eA„ f„(a_„,x„)eSR„(a_„) 

where 5„ is the achieved utility of user n in the worst-case approach. The domain of optimization problem 
([141 ) is defined by 

An{a^n) = AnX 5Rn(a_„) (15) 

which is a function of other users' strategy. We represent the RACG by ^ = {Af, {un)neAf, A} where 
A = Yl^^iAn{si-n)- The solution to ([T2l ) for user n is a pair (a^,f^(a_„,x„)) G An x K„(a_n) that 
satisfies |[T3l 

max 'u„(a„,f'„(a_n,x„)) = u„(a^,f'„(a_n,Xrt)) = min M„(a'„,fn) (16) 

ar.e.4„ f„{a_„,x„)6R„(a_„) 

which is the saddle point of (fT2l ). Using the above, the equilibrium of the robust game Q is defined below. 

Definition 2. The RNE of RACG corresponds to the strategy profile a* = (a^, • • • if and only if 
for any other strategy profile a„ we have lIlTI 

min Un{al,(n{a*_n,Xn)) min u„(a„, f„(al„, x„)) VariGA(a-„) (17) 

f„(a_„,x„)G5R„ f„(a_„,x„)e5R„ 
We denote the achieved utility of user n at the RNE by n* and the social utility at the RNE by u* = 

IV. RNE Analysis: Existence and Uniqueness Conditions 

Now we derive the characteristics of the RNE in the RACG from the NE in the NACG. For convenience, 
in what follows, we omit the arguments a_n and x„ in f„(a_n,Xn). 

A. Existence of the RNE 

To analyze the existence of RNE, we encounter two problems. First, by considering uncertainty in the 
utility of each user, the utility may become non-convex, and analyzing RNE may become impossible. 
Second, the strategy space of user n changes to ^„(a_„) = An x $R„(a_„) which is not a fix set and is 
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a function of the other users' actions. Therefore, convexity of the optimization problem of each user is 
not a sufficient condition for the existence of RNE, meaning that we need to utilize VI in the sequel. 

Lemma 1. 1) For the uncertainty region in (fTTt . the strategy of each user is a convex, bounded, and 
closed set. 2) ^'„(a„,a-_„) is a concave and continuous differentiable function of a„ for every a„n> 
where, 

^'n(a„,a_„) min n„(a„, f„) = 'u„(a„, f„) (18) 

f„G5R„(a_„) 

and 

Z=fn- En^n (19) 

where Xi = [/«,•••, 7^1, '^n = [di, ■■■ , i^nl and i?^ is defined as 

9nJ;(a„,f„) 

< = =. (20) 

The robust game is Q = {M, {"^)n£j\f,A}. 

Proof: See Appendix A. ■ 
Theorem 1: For any set of system parameters and strategy space of users, there always exists an RNE 

for g. 

Proof: From part 2) in Lemma 1, RNE is an instance of the generalized Nash equilibrium (GNE) 
(see (2) in IH), and a* is the RNE iff it is a solution to QVI{A,^), where T{a) = {Tn{a))^^^ 
and J-'n(a) = — ^"^"ga Since ^ is a convex set and ^.„(a„,a_„) is a concave and continuous 
differentiable function with respect to a^, the necessary convexity assumptions for the existence of a 
solution to QVI hold (Theorem 1 in ll22l ). meaning that a RNE always exists. ■ 

B. RNE's Uniqueness Condition 

Since the closed form solution to ([T4] | cannot be obtained, the fixed-point algorithm and the contraction 
mapping cannot be applied as in ||7l, lITOl to derive the conditions for RNE's uniqueness. To overcome 
these difficulties, we show that the RNE can be considered as a perturbed NE of the NACG, and that 
the condition for RNE's uniqueness can be derived without a closed form solution to ([T4] |. 

Lemma 2. T{a) is a perturbed bounded version of mapping J^(a). 

Proof: See Appendix B. ■ 

From Lemma 1, ^ is a closed and convex set, and form Lemma 2, T{a) is a perturbed bounded 
mapping ^(a). Therefore, the RNE is a perturbed solution to VI {A, T). Consequently, RNE's uniqueness 
condition can be obtained from the perturbed NE's uniqueness condition. 
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Theorem 2. When T is a P matrix, for any bounded value of A = [ei, • • • , sn]'- ^) G has a unique 
RNE; 2)The social utility at the RNE is always less than that at the NE, i.e., u* < v*; 3) The distance 
between the strategy spaces at the RNE and at the NE is 

„ ^ IIAII2 

a*-a*2<^|r (21) 

where Csm is the strong monotonicity constant for mapping T. 

Proof: See Appendix C. ■ 
From Theorem 2, RACG's performance can be examined and compared to that of the ACG through 
the difference between the upper bound of users' strategies in (|2TI ) at their equilibriums. Also, from 
(1211 ). the social utility's reduction at the RNE (compared to NE) can be approximated. Consider W(a) = 
(W'=(a))f^p where W*^ is a X matrix whose elements are 

if m = n 



In part 4 of Appendix C, we show that the difference between social utilities at the RNE and the NE is 

lb*-r||2~ ||W(a*)||2 X (23) 
When T is a P matrix, a* is the attractor for VI{A,F) (Proposition 2.4.10 in JH), i.e., 

lim lla* -a*||2 = Va* G ^, a* G A 
meaning that when uncertainty approaches zero, the RNE converges to the NE. 



C. Numerical Validation 

Consider the power allocation problem (Example 1 in Table I), where the transmit power of user 
n on sub-channel k is in (dJ. We have — Vn{3Ln-,^n) = diag( „ — ^ — ^ \2 )k=i- 
case, a^^^'" = min( )^ and -Va„a„';^n.(a„,, f„) = diag( (a^+j2^^"j^<h'„„.r -'^=i" therefore, 

l^nm — ^-k^■^=^■ — ""min hk \i ■ For simplicity, assume that the normalized noise power in all sub- 
channels for each user are the same, and a™^ = 0. In such cases, the matrix T is a P matrix iff 

1 J^k 
min — — =- — — > max , ""I Vn G M , (24) 

which is the uniqueness condition for the power control game. Otherwise, the power allocation problem 
may have multiple Nash equilibria. As a numerical example for Theorem 1, we consider two users and 
two sub-channels, and assume a™^^ = = 1. To ensure that the monotonicity condition (|24] | of the 
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power allocation game holds and T is a P matrix, the interference channel gain between users is chosen 
much less than the direct channel gain between transmitters and their receivers, i.e., hnm < 0.01. In our 
simulation, the matrix T is 

1.5432 -0.016 
-0.0012 1.221 

Since (l24l ) is satisfied for the above matrix, it is a strictly monotone matrix. Figs. [T] (a) and[T](b) show the 
mappings J^i(a) and /2(a) for the allocated power levels in subchannel 1 for users 1 and 2, respectively. 

For 71 G {1, 2}, the mapping J-'n(a) is obtained by considering a fixed transmit power of the other user, 
and as we show in Figs. [U (a) and [T] (b), it is monotone. Fig. |2] shows the surface of the social utility of 
users 1 and 2 for a^ and a^ as their strategies in sub-channel 1 and 2, respectively. We consider e„ < 0.8 
for both users. In this case, our simulations show that: 1) Both the NE and the RNE are unique; 2) The 
social utility at NE is + = 1.6. The social utility at the RNE is 2* + = 0.585, which is less than 
the social utility at the NE, as expected from part 1 in Theorem 1; and 3) At the NE, the allocated power 
for users 1 and 2 are (a^^ = 0.5, a^^ = 0.5) and (03^ = 0.4, = 0.6), respectively; and the RNEs for 
users 1 and 2 are (al^ = 0.4, aj^ = 0.6) and (Sg^ = 0.9,02^ = 0.1). In this example, the upper bound 
in (I2TI ) is 1.3115, and the exact value of ||a* — a*|[2 is 0.7211, which is less than its upper bound (1211 . 



Consider ||W''(a)||2 = \J (Amax(W*''(a)W''(a)), where W**''(a) is the conjugate transpose of W''(a) and 
Amax is the maximum eigenvalue of the matrix. In our simulation Amax(W*^(a)W^(a)) = 0.9091 and 
Amax(W*^(a)W^(a)) = 0.59. From dlU, the distance between the social utihties at the RNE and at the 
NE is 1.02, and in simulation, this difference is to 1.015. Note that all of the above results validate 
Theorem 2. 

V. Logarithmic Utility Function 

We now consider a special form of uncertainty region and utility function that are pertinent to Example 
1 in Table I, to show that in such cases, VI becomes very simple, and the strict monotonicity requirement 
is relaxed to the positive semidefiniteness of an affine mapping. Let the utility of each user be |j23l 

log(4 + ^), if 9 = 1 

" (25) 
if - 1< 6* < or 9 < -1 



where is the fixed system parameter related to each dimension of each user Assume that for the 
uncertain parameter of each user, we have = + where x^^, x,^^ and are the actual 
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value, the nominal value, and the error, respectively. The uncertainty region for each user is 



\ E (5^)^<^n}, Vfe (26) 



nm 



where is the bound on the uncertainty region for user n in sub-channel k. The above formulation 
models the power control game when uncertainty emanates from variations in the channel gain between 
transmitter m and receiver n. 

Proposition 1. For an ACG with utility function (l25T i: 1) The NE is the solution to an affine VI denoted 
by AVI{A,M) where M{a) = {Mn{a))^=i, and 

N 

Mnia) =yfn+Y. Mnma^ (27) 

m=l 

where w„ = and M^n = diag(^|^)^j^. 2) Consider a N x N matrix M™'^^ whose elements 

are 

maxfcg^ ^ if m^n 
otherwise 
The NE is unique when 

max lia^, II2 > >^ MZr\KM2, Va„ G An, yn,mGM. (28) 

Proof: See Appendix D. ■ 
From Proposition 1, when the impact of users on each other is sufficiently low, the NE is unique. 
For the example of power control game. Proposition 1 implies that when interference between users is 
sufficiently low, the NE of NACG is unique |[24l . ll25l . We now derive the RNE' uniqueness condition 
for such cases. 

Theorem 3. For the utility function 1) The AVI mapping of the RNE is M{a) = (A{(a))^=i, 
where 

MniSi) = Mn{a)+Mn{a), £ M, (29) 

where Al„(a_„) = (e^,||a^„||)f^i and a^„ = [o^,-- - , a^_i, a^+i, • • • ,a%]; 2) When (EUl holds, the 
RNE of Q is unique for any bounded e^; 3) When ( [281 ) holds, the total utility of each user at the 
RNE is always less than that at the NE, and the upper bound on the strategy space of each user is 
l|a*-a*ll< liSILy. Where 



En 



||e„||oo if m = n 
otherwise 
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where Amin is the minimum eigenvalue of matrix M™^", e„ = [ejj,-'' > ^^d ||.||oo is the maximum 
element of the vector. 

Proof: See Appendix E. ■ 
Remark 3. From Theorems 2 and 3, RNE's uniqueness condition is not related to the size of the 
uncertainty region. Theorems 2 and 3 show that for a closed, bounded, and convex uncertainty region, 
RNE's uniqueness condition is the same as NE's uniqueness condition. By rearranging AVI of the RNE 
for the utility function (1251 ). the best response solution of the RACG is 

J_ I max 

a'n = [AI - ^^4^ - - ^lla-nlC- > (30) 

which is similar to (13) in IITtI for the power control game in spectrum sharing environments. From 
Theorem 2 in ifTTI , the RNE's uniqueness condition is related to the size of the uncertainty region. But 
if we use VI to analyze the RNE, its uniqueness condition is independent of the size of the uncertainty 
region. 

VI. Distributed Algorithms 

To develop a distributed algorithm for this class of games, we use the proximal-response map a. 
Consider a = [ai, • • • ,aAr], where a is the solution to following optimization problem with respect to b 



^ 1 
a(b) = max[J]]^'„(a„,b_„)--||a-b||^], (31) 



N 

where b = [bi, • • • ,1)^] belongs to A. The above problem can be decomposed into N subproblems as 



a„(b) = max [^„(an,b_„) - ^||an - bnll^], ,be^(a_„), yneJ\f, (32) 

a„e»4„(a_„) 2 

In this way, a distributed iterative algorithm is developed. Consider a^ and b„ as solutions for user n in 
the current and pervious iterations, respectively. When a user is informed about the other users' solutions 
before updating its strategy, it can obtain the solution to (l32l ). The distributed algorithm based on proximal 
response map is summarized in Table |II1 where users update their transmit strategies at discrete instances 
t denoted by T = [1, • • • ,T], an{t) denotes the transmission strategy of user n at iteration t, and (n{t) 
is the observation of user n at t measured by its receiver and sent to the transmitter. 

In Theorem 4 below, we obtain the conditions for convergence of the iterative algorithm. 

Theorem 4. As T — > oo, the distributed algorithm in Table |II] converges to the unique RNE from any 
initial strategy a„(0), if T is a P matrix, and = ^ ^ = 0. 

Proof: See Appendix F. ■ 
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Note that the condition ^ Q2^kQ'IP = holds for the Jackson network. For the power control game, 
when T is a P matrix, interference in the system is very low, and consequently, the signal to interference 
and noise ratio of each usr is high. For this case, " >> 1, and the utility function of each user is 
u„(a„, f„) = X]fc=i log( ^"^"" ) which also meets ^ gl'^kg'p '^ = 0. As we see in Theorem 4, the distributed 
algorithm converges to the unique NE when T is a P-matrix irrespective of the size of the uncertainty 
region, so long as the uncertainty region is closed and convex. 

Remark 4. In Lemma 1, we showed that = 'Un{^n,fn — ^n'^n) is concave. Also the proximal 
response map is strictly convex. Therefore, the Lagrange function can be used to derive the solution to 
(l32l) for each user at each iteration as 



1 ^ 
L„(a„,/i„) = n„(a„,fn - - -||a„(t) - a„(t - 1)||2 - /i„(^a^ - a^'^"), 



(33) 



fc=i 



where is the lagrange multiplier for user n that satisfies 

K 

fin{^a'^-ar) = 0, (34) 



The solution to (1331 ) with respect to a,„ is 



k=l 

k 



(35) 



User n solves (1351 ) to obtain a„(t) in each iteration. For (l25T l. the proximal map's solution is 

AT 



>f„(a(0)=w„+^M„„a^(t-l)+X„, (36) 

m=l 

where Z„ = (a,^(i) — a^(t — 1))^^. For example, the proximal map's solution to the power control game 
is 

ai{t)=\[xi - - Y: "'"""H' ~ - ^nll«-n(* - 1)11 + -nit - (37) 

^ m^n ^"'^ 

VII. Effects of Robustness on Social Utility for the Case of Multipls NEs 

So far, based on NE's uniqueness condition, we obtained RNE's uniqueness condition. Now we study 
the characteristics of RNEs when NACG has multiple NEs. In general, doing so is not straightforward 
since the VI mapping for NACG is non-monotone and non-smooth, which makes it difficult to study the 
characteristics of the perturbed NEs (RNEs) ||26l-l|28l. 

To compare the case of multiple NEs with that of a single NE, consider the power control game, 
when T is not a P matrix (e.g., h^^^^ > 0.5). The mapping T is non-monotone for both users. As we 
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see in Fig. |3l there are multiple local optima on the surface of the utility function that correspond to 
multiple NEs for this game. In this case, at the nominal NE, the convergence points for users 1 and 2 
are (a^ = 0.534, af = 0.463) and (a^ = 0.417, = 0.583), respectively, and + = 3.0176. When 
uncertainty is e„ < 0.8, the RNE converges to (al = 0.556, Sf = 0.444) and (a^ = 0.325, a| = 0.675), 
and ul + U2 = 3.077. This example points out that introducing uncertainty may increase the social utility 
at the RNE when the NACG has multiple NEs, which is in line with simulation results in |[T6l . IITtI . 
|[29ll . This is because RNE relates to one local optima on the surface of the utility function, which is 
different from the local optima at the NE. Also, considering uncertainty results in users interfering less 
with each other at the RNE compared to the NE ||29l . 

This observation shows the benefit of implementing RACG in communication systems which may 
increase the social utility as compared to that of NACG. But, obtaining the conditions under which the 
social utility increases is not easy. This is because utility function of each user is a non-linear function 
with respect to its uncertainty region and the other users' uncertainty regions. So, we focus on a special 
case where the strategy of each user is a decreasing function of the bound of uncertainty region. In 
Proposition 2 below, we obtain the condition for increasing the social utility of the RACG as compared 
to that of the NACG. 

Proposition 2. When W is a semi negative definite matrix and Vj^a^ < for all users, the social 
utility at the RNE is higher than that at the NE. 

Proof: See Appendix G. ■ 

Proposition 2 implies that when the reduction in the social utility due to the decrease in user's strategies 
is less than their increase in the social utility due to the decrease in other usrs' strategies, introducing 
robustness in the game increases the social utility. Note that this is one case in which the social utility 
at RNE is higher than the social utility at the corresponding NE, and there may be other cases as well. 

Remark 5. When the solution of affine VI is a monotone decreasing function of the AVI mapping 
is a semi-negative matrix (See Appendix H). For the power control game. Proposition 2 is simplified to 



This means that when all interference channel gains are sufficiently greater than the direct channels 
gains, introducing robustness increases the social utility. This is an opportunistic phenomenon in robust 
games when the game encounters multiple NEs. In order to benefit from this and increase the social 
utility, we propose an opportunistic distributed algorithm in Table |lIIJ Obviously, checking the conditions 
of Proposition 2 in a distributive manner is not easy. In addition the social utility may increase under other 



max 




(38) 
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conditions. Therefore, all users play the game Q without considering the uncertainty. If a™'" < Xlm^n f^rn'^ 
for user n, i.e., the NACG has multiple NEs, users assume uncertainty in their observations. When their 
utilities increase, they expand their uncertainty regions. Otherwise, they interrupt the algorithm. In this 
way, all users make an effort to escape from their local optima in a distributed manner by playing the 
robust game. To implement this algorithm, we assume that users update their transmit strategy at discrete 
time slots ti = 1, 2, • • • , Ti with duration of r. The vectors a„(ti) and fn(ii) are the transmit strategy 
and the observation of each user at the end of the iteration time ti. Besides, users exchange the values 
of a„(ti) and u„ at the end of each iteration. 

VIII. Simulation Results 

We use simulations in the two examples in Table I to provide an insight into the performance of Q for 

different bounds on uncertainty region as compared to that of Q. In the following simulations, the value 

llY f II 

of £n is normalized to the nominal value of f„, i.e., e„ = " jj^ || , each uncertainty region is considered 
as a linear norm with order 2, i.e., an ellipsoidal region, and uncertainty for all users is assumed to be 
the same, denoted by e. 

A. Power Control Game 

For the power control game, we begin by studying the effect of uncertainty on its performance in both 
robust and non-robust approaches in terms of utility variations at their equilibria. To do so, we consider 

= 3 users and K = 16, and the amount of uncertainty is assumed to be e = 50% at the RNE. After 
convergence to the RNE and to the NE, the system parameter varies uniformly from 50% to 150%, which 
causes variations in the utility of each user at the NE and at the RNE. Variations in the social utility 
are shown in Fig. ID Note that the social utility varies considerably at the NE of the nominal game for 
both values of [50%, 150%], meaning that communication is very unreliable from the user's perspective. 
In contrast, the total system utility at the RNE of the robust game is stable for both cases. Note that 
although we assumed e = 50% in the RACG, reliable transmissions is provided even at values higher 
than £ = 50%, e.g., up to 150%. 

Next, in Fig. [51 we compare the effect of uncertainty when Theorem 2 holds with that of the case when 
it does not hold, in terms of the ratio of the social utility at the RNE and at the NE for different amounts of 
uncertainty. Simulations are performed for Rayleigh fading channels for bounded and uniformly generated 
errors for each cross sub-channel gain. To satisfy the NE's uniqueness condition, the channel gains are 
obtained in such a way that hnm < 0.01, and for multiple NEs, we set ~hnm > O-^- The ratio of the 
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social utility in Fig. |5] is obtained by averaging over 100 channel realizations. Note that when the NE 
is unique, the total throughput of the system gradually decreases, but for the case of multiple NEs, no 
uniformity is observed. For example, when e = 10%, the total achieved utility is higher at the RNE as 
compared to that at the NE; and when e = 20%, the ratio falls substantially. The trend is not monotonic 
for different values of uncertainty, e.g., the social utility at the RNE is higher for e = 50% as compared 
to those for e = 40% and e = 60%. In Fig. [6l the throughput of the users versus iteration numbers are 
shown for the proximal response map when e = 80%. Note that as shown in this figure, the convergence 
time of the proximal response map is longer than that of the IWFA without any uncertainty for users. 

Finally, in Fig. |7J we compare the performance of the opportunistic approach with that of the nominal 
game using 

r/ = (39) 

V* 

where is the achieved utility of user n by utilizing the opportunistic algorithm at the end of the 
algorithm. The value of rj is obtained by averaging over 1200 channel realizations for N = [4,6,8], 
K = [32, 64] for different values of hnm- Note that for very high interference levels, i.e., when hnm ^ 
the efficiency of the proposed opportunistic approach is considerably higher as compared to that of 
moderate interference levels, i.e., when hnm ^ 1- Thus, the opportunistic algorithm performs significantly 
better in high interference levels when the number of sub-channels is high. 

B. Jackson Networks: M/M/1 

To show the effect of uncertainty on the system performance in Jackson networks, we consider a 
network with = 5 nodes and K = 3 traffic classes. Figs. [8la) and [8lb) show the effect of uncertainty 
in 'ip'^ on the convergence of Jacobi scheme and the gradient approach for reaching the NE. In this figures, 
we show the percentage of increasing the total delay in the network under perturbation as compared to 
that at the NE, i.e., D = ^^r-%, where d is the total delay under perturbation and d* is the delay at 
the NE. Note that when robustness is not applied, neither of the two algorithms converge to the NE, and 
increasing uncertainty increases the queuing delay. Figs. |9](a) and|9](b) show the RNE for e = 20% and 
e = 70%, respectively, by using the proximal response map. Note that in both cases, the RNEs converge 
to the vicinity of the nominal NE as compered to Figs. [Ha) and [8] (b). For example, when e = 70%, the 
total delay increases up to 2% as compared to that at the NE, while the total delay is about 1.423% at 
the RNE. Therefore, RNEs are stable, and the iterative algorithm converges very fast. Note that proximal 
response map, the convergence rate increases when uncertainty region is expanded. 



17 



Fig. [To] shows the probability of RNE's convergence, versus the total routing probability 1 — r^Q for 
different uncertainty regions. Note that by increasing uncertainty, the system converges to the RNE for 
a smaller value of (1 — r^g) as compared to that of the NE (i.e., e = 0). For example, if e = 40%, 
only for (1 — r^g) < 0.3, the system converges to its equilibrium, while for e = 10%, the value of 
(1 — r^o) '^^^ 0.5 for convergence to the RNE. Fig. [10] shows that the effect of uncertainty 

is more profound in a network with a high probability of packet loss, causing poor performance, i.e., 
large delays in the network. Therefore, from a practical perspective, when the system encounters a high 
degree of uncertainty, all nodes should reduce their probability of packet drops and increase their routing 
probability. 

IX. Conclusions 

We studied the RNE for a wide range of problems in communication systems and networks when 
users' impact on each other can be modeled as an additive function of system parameters and users' 
strategies. In this game, since the user's observations of these impacts are uncertain, each user optimizes 
its utility using worst-case robust optimization. We showed that the theory of finite-dimension VI and 
its sensitivity analysis can be used to obtain the conditions for the existence and uniqueness of the RNE 
when there is no closed-form solution to the optimization problem of each entity. We also proposed a 
distributed algorithm for reaching the RNE. In the case of multiple NEs, simulations showed that at a 
RNE, the social utility may be higher than that at the NE, and we derived the conditions for observing 
such a case. To benefit from this, we proposed a distributed algorithm to improve the social utility at the 
RNE. Simulations confirmed our analysis for two examples, namely, the power control in interference 
channels, and delay minimization in Jackson networks. 

Appendix A 
Proof of Lemma 1 

1) tn is a linear function of other users' strategies and system parameters. Besides, the norm function 
is a convex function bounded to e„. Therefore, An{3i-n) is a convex, bounded and close set. 2) To prove 
the concavity of ( [TSt with respect to a„, consider ^'„(a^), and ^'^(a^) for any positive value /x € [0, 1]. 
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We have 

^'„(/iai^ + (l-^)a^) = _ min ?Xn(/iai + (1 - /i)a^,fn) (40) 

f„e7e„(a_„) 

> _ min fiUn{al^,{n) + {I - IJ')un{ai,fn) (41) 

f„G7^„{a_„) 

> _ min ^u„(a^,f„) + (1 - /i)^ min u„(a^,f„) (42) 
f„e7e„(a_„) f„e7e„(a_„) 

= /i*„(ai) + (l-/i)^„(a2), (43) 

Note that inequahty (|4T]) is based on concavity of u„(a„,f„) with respect to a„. Therefore, ^'„(a^) is 
a concave function of a„. Based on concavity of ^„(a^), the Lagrange dual function of ([T8] ) for the 
uncertainty region is 

K K 

L(a„, f„, A„) = uiial j^) - A„(e" - ^{7!; - f^f) (44) 

k=l k=l 

where A„ is the nonnegative Lagrange multiplier that satisfies (ITTI i. i.e., 

An X -^(7^- 4^)2) =0 (45) 

fc=l 

The solution to (|44l) for can be obtained by the optimality condition of the optimization problem 
without the constraint ll30l . i.e., ^-^(""'Z'"^") = o, which is equivalent to 

^"""l"^/"^ = -2A„ X (7^ - /„^) VA; e /C (46) 

Considering (|46l ) in (|45] ). the uncertain parameter is f „ = f „ — Eni^n, where f„ = [/*,••• , f^*]^ ''^n = 
[<,••• and < is 



^'^ = (47) 



9«J;(a„,f„) 

Using 1?^ in the utility function i4„, we have 

*„(a„,a_„) = u„(a„,f„)|j--^j^_^^^^, (48) 

Comparing (l48T l with f„(an,fn) indicates that the difference between and the utility function of the 
nominal game is the extra term e^'i^n- From A2, SnT^n is continuous. Therefore ^„(a„, a__„) is continuous 
with respect to a„. The derivative of ^„ with respect to a„ is 

Va„*n(an,a_n) = Va„ttn(an,f„ - e„l9n) + (Vj^U„(an,fn - ^n'^n) X 1/^) X Vajn (49) 
= Va„ttn(an, f„ - Enl^n) " £« ( n.„ (a„ , f„ - e„i9„) X Ik) X Va„1?„, (50) 
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Where Ix is a 1 x K vector whose elements are equal to one. The last term in (ISOl l contains g^^rgjir- 
From A3, the term Q^k^"p exists. Therefore, ^'„(an,a_-n) is differentiable with respect to an- Now, the 
optimization problem of each user can be rewritten as Un = max^ x7e„(a_„) ^nl^nj^-n)- Therefore, 
the game can be reformulated as {M, "i>n,A}. 

Appendix B 
Proof of Lemma 2 

For the RACG, we have VI{T,A), and T{a) = {Tn{a))^^-^, where 7^„(a) is obtained by dSO]! for 
user n. Let z„ = {x„,am} denote variations in the system's of parameters and other users strategies 
for user n where x„ and a^ are variations of x„ and am, respectively. When e„ = 0, we have z„ = 
and vice versa. From Al and A2, the mapping Tn is continuous and differentiable around the uncertain 
parameters. We use the Taylor series of the uncertain parameter and write 

^ ^ ^ °° I ^ 

Fn{a) = [J:„(a)]^„=o + en[V,„ J-„(a)]^„=o + E Ty(e„)*(V|„ J-„)]i„=o (51) 

i=2 

For e„ = z„ = 0, (ISTI ) is equivalent to 

j;(a) = - [Va,. tin (an, fn " Snl^n) " en(Vf„ltn(a„, f„ - e„l9„) X li^ ) Vz„ l^n] (e„=0) (52) 
- Y[Va„/„^n(an,fn " en1?n)Vz„/n - £„ Vf^f^M„(a„, f„ - Vz„1?n](£„=0) (53) 

-- ^[V|,„_^„2n„(a„,f„ - e„i9„,)(Vz„/n)^ x ij,, + V2^^^n„(a„, f„, - e„i9„)v2^z„fn x l^](e„=o) (54) 
+ o 

From ([T3T l. the first term in (|52T l is equal to — Va^tinCan, fn)- Since in is a linear function of system 
parameters, the last term in (|54] | is equal to zero. From (|6), we have 

~ e 

Fn{a) = Fn{a) - y [V2^_f^i;„(a„,f„) x Vz„/n] - ^[V^„/„^^^n,(a„,, f„) x (Vz„/n)' x 1^] + o, (55) 

From Al, all the derivatives of Vn{amin) are bounded. Therefore, the last terms in (l55i are bounded, 
and 7>i(a) is the perturbed bounded version of J>i(a). 

Appendix C 
Proof of Theorem 2 

1) Consider the bounded perturbation of mappings T{a) and T{a) caused by variations in system 
parameters as Q = ||J^(a) — /'(a)||2 Va„ G A. Since the strategy space of all users in each dimension 
is bounded as in (HJ, and the uncertainty region is bounded and convex, this region is also bounded, i.e.. 
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^max _ niaxag^ minj ^ ~ •^(a)||2 < oo, Vn € Af. Any solution to the worst-case robust 

optimization in (fT2l) corresponds to a realization of VI{A,T) = VI{A,T + q), where q = Q' x (l]^)]^, 
and q £ Q depends on (a„,f„) obtained by ([T6l ) for each user, and always q < g™'"'. When T{a) is 
continuous and strictly monotone on the closed convex set A, meaning that T is a P matrix, the solution 
to VI{A,T + q), denoted by <&(q), is a monotone and single-valued mapping on its domain (Exercise 
2.9.17 in [21), i.e., 

Vq, = q^x ,q, = q, x , q„q^ G Q ^ (cl>(qj - $(q,))(q, - q,) = 0, (56) 

Thus, when qi ^ qj, we have <l>(qj) = <^*(qj), which is single valued on Q, i.e., a unique solution for all 
q £ Q. This completes the proof of the uniqueness of RNE under the P property of T. 2) Recall that 
when T is a P matrix, T{a) is strictly monotone, and the utility is strictly convex. Since A is convex 
in M^, and T{a) : K — > M^^ is a continuous mapping on A, the solution to VI{A, J-" + q) is always a 
compact and convex set (Corollary 2.6.4 in [2]). Also, since a* is the optimum value of this convex set 
for VI{A,F), i.e., g = 0, any point in this set is less than a*, which is a solution to VI{A,T + q). 
Note that a* belongs to this set. Since T is a P matrix and is strictly monotone, we have 

V a„ < a* =^ Un{a )<n„(a:,a*_J Va G ^ (57) 

which is also valid for a*. As such, the utility at the RNE is less than that at the NE. 3) Since T is 
strongly monotone, there is a unique solution denoted by a* = <I>*(q), which can be considered as the 
worst-case robust solution to Q for ||q||2 < ||A||2. Now, both a* and a* must satisfy 

< ($*(q) -$*(0))(J-($*(0))) and < ($*(0) - $*(q))(7-(«>*(q)) + q) (58) 

where = {Ok)i and Ok is the K x 1 all zero vector. By rearranging |58] we get 

($*(0) - <D*(q))(7-(ci>*(0)) - J-(<l>*(q))) < (1>*(0) - «>*(q))q (59) 

Since <&*(q) is the co-coercive function of q (Proposition 2.3.11 in |2|), the left hand side of ( [59l ) is 
always less than Csm||*^**(0) — <I>*(q)|p. Using Schwartz inequality for the right hand side, we have 

||($*(0) - ^'*(q))q||2 < \\<^*{0) - <I>*(q)||2||q||2. (60) 

Since <I>*(0) and 'l>*(q) correspond to a* and a*, respectively, (|2TI ) can be obtained. 4) Since the difference 
between utility functions of each user at RNE and at NE is equal to first term of the Taylor series of 
Un{an,(n) with rcspcct to all variations in the strategies of user n and other users, we have 

<iat f'n) - v'nial fH) ^ X ^ + ^"^ X gg) VnGAA, k e IC, (61) 
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which is equivalent to 

^,kfk fk\ „k/k nk\ ^ ^ ( dVni'^n^ fn) ^"n , (^'^ni^'n^ fn) ^/n d^-n ^ 
^„(«n,/nj Vn[an,!n) - X— + ^ 

~ '"^ "^d^^ df^ (62) 

When En is sufficiently small, the derivative of the strategy of each user is approximately equal to 

lim"-'-<'=|^, (63) 
By expanding (l62l ) for all users in the game, we have 

||i;(a*)-7x(a*)||2~ ||W(a*)||2 x ||a*-5*||, (64) 
by replacing (1211 into (|64] |. the approximation (|23T l is obtained. 

Appendix D 
Proof of Proposition 1 

1) From (l25T l. the best-response of the NACG is 

1 _|_ 7/^ 

- l^n —k 2^ :;:^«mJamin, (65) 

where the Lagrange multiplier A„ for each user is so chosen to satisfy the sum constraint Ylik=i — ^n^^- 
Therefore, the best response of this problem can be written as an AVI, denoted by AVI{A, A4), where 
M-n is obtained from ( [291 ) ||2l. 2) For this case, the game has a unique NE when A4{a) is strongly 
monotone or when M(a) = (M„m(a))m n=i positive definite (Sections 2.3 and 2.4 in lH). By some 
rearrangements, we have 

M(a) = (M(A;)(a))f=i (66) 

where [M(A:)]„m = ^l^- When all M(A;) are positive definite matrices, M{a) is strongly monotone. 
Consider M™'^^ in (l28l ). and its strictly lower and upper triangle matrix as Mlq^, and M"pp^, respectively. 
Let b = I - Mf^^^ - M^p^ and pn = Wsinh- When for any p = [pi, • • • pat] > 0, we have 

N 

maxp„ BnmPrn > 0, (67) 
n=l 

all M(A;) for all k are positive definite matrices (Proposition 1 in ||24]| ). By rearranging (|67| i. we obtain 
(1281 ). Therefore, when (|67] | holds, AVI has a unique solution and consequently, the NE is unique. 
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Appendix E 
Proof of Theorem 3 

1) From Lemma 1, the map of RACG is the perturbed map of NACG. Since the map of NACG is 
Unear for the utiUty function (|25l l. the perturbed map is 

N -I, 

MHa) = wt+Y.^ai, V^L€7^^ (68) 

m=l 

where A4^{a) and w'^ are the /c* elements of M.{a) and w„, respectively. Now, (1681 ) can be rewritten as 

N ~u ~h, I, N h, 

W=^n+ l^\-T~^ )am<w^„+ 2^ -^a^ + enl|a-nlli (69) 

Therefore, the map at the RNE is (|29] |. 2) Since ajj, is bounded in [a™^, a™^] and the uncertainty region 
is bounded, the value of e^||a^„||2 is bounded. Therefore, for any bounded uncertainty region considered 
by users in the RACG, its AVI can be rewritten as AVI = {A,M + m), where m = (m„)^^^ = 
(w„ + Mn)n=i and ||m||2 < oo. Therefore, the RNE is the perturbed solution to AVI = {A,M). From 
Theorem 4.3.2 in ill, when M is semicopositive, the AVI has a unique solution for any value of m. 
Therefore, the robust game has a unique solution for any bound on the uncertainty region. 3) The second 
part can be obtained the same as in part 2 of Theorem 1. Recall that A4 is strongly monotone on A 
when there exist a Csm> such that for all = (a„)„g;v^, and a^ = (an)neA^ we have 

(a^ - a^){Mia^) - M{a^)) > c^m || - a^ || . (70) 

When = (o^^ — On^), for our linear formulation we have 

N 

iai-al){Mn{a^)-Mnia^)) = (a^ -a2)( J];(M„^a^ -M„^a2j) = 

m=l 

E(ar-af)[EM„^i(ar-af)>f;(e^,)2- lE^^^^^I 

k=l m=l k=l m=l,m^n k=l 

K N K k ^ ^ 

k=l m=l,m^n k=l k=l m=l 

Therefore, for all n G A/" we have 

(a^ - a'^){M{a^) - M{a^)) > eW^'^^e (71) 

Given ([T]) and summing over q, since M™^" is positive semi-definite, we have 

eM--e> A™„(M™-)||e||2 (72) 

Therefore, the lower bound of the strong monotonicity constant in A4{a) is obtained. By replacing (l72l ) 
into (|2T]) . part 3 of Theorem 3 can be obtained. 
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Appendix F 
Proof of Theorem 4 

When the solution to (|3T] ) is obtained by the non-expansive or contraction mapping, the distributed 
algorithm for the proximal response map converges. For any vector z G ^ in (|3T]) . we have 

(z-a(bi))[^(a(bi),bi) + a(bi)-bi] >0 (73) 

(z-a(b2))[^(a(b2),b2) + a(b2)-b2] >0 (74) 

Considering z = a(b2) in (1731 ) and z = a(bi) in (1741 ). from the above two inequalities we get 

< (a(b2) - a(bi))[.F(a(bi),bi) +^h') - h'] + {^h') -a{h'))[Tmh^)y) + a{h^) - h'] (75) 

= (a(b2) -a(b^))[.F(a(bi),bi) -.F(a(b2),b2)] - ||a(b2) -a(bi)|| + {^h^) -^h')f{h' -h') (76) 

Recall that Tn = -Va„'Un(a„, fn + ffn^^n) -e„Vj n„(a„,f„ + e„i9„) x Va„i9„, Va„-F„ = -V^^ .,^u„ + 

^1 ^ '^a„a„f„^n Va^Jk = -Va„a„^in + £1 X Vl^^gsj^UnXnm- When = = 0' <ESI) 

can be written as 

(a(b2) - a(bi))[ J] -Vla,.^n](a(b2) -a(bi))T (77) 

nGA/" 

+ (a(bi) - a(b2))[ -Va\a„.nn,](bi - b^)^ - ||a(b2) - a(bi)|| + {^{b') - a(bi))(bi - b^)^ > 

Let5„(a) = be the smallest eigenvalue of -V2^n„(a„,f„(a_„,x„)), (a) = ||-Va„a„Wn(an,fn(a-n,Xri,))|| 
for n / m, and z = T(ai(b^),b^) + (1 - T)(a2(b2), b^). From dTTjl we get 

N 

(l + 5„(z))||a(b2)-a(bi)|| < j;^„^(z")||bL„-b2„J|, (78) 

n=l 

On the other hand, 

- '^a„a„^n = " Va„a„^in(a„, fn - ^nl^n) + e„V~^'U„(a„, f„ - £^1?™) X Va„l9n- (79) 

Since the utihty is a convex function with respect to a„, the first term in (iTQl l is positive and || > 

||Va^a„^n||- BcsidcS, 

Va„a„^n = Va„ a„ (an , f n + Sn'l^n) " En (a^ , fn " ^n^J^n) X Va„1?n, (80) 

which leads to |lVa^a„^n|l < l|Va„a,„^nll- From these two inequalities, (1781) can be written as 

N 

(1 + an(z))||a(b2) -a(bi)|| < J] /3„„,(z")||bL„ - b2„J|, (81) 

n=l 

For (ISTT i. when T is a P matrix, the proximal response map in (|32] | is a contraction mapping (Proposition 
12.17 in ||3l), and converges to a unique RNE from any initial point. 
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Appendix G 
Proof of Proposition 2 

Variation in utility function of each user for variation in the bound of uncertainty region is 
lim Ven„(a„,f„) = (Va„'yn(an, fn) X Ik) x V£„a„ + (Vf„7;„(a„,f„)x„„)Ve„am 

e->-0 

-\-£n X Vanrn"*^"!^"' ^ ^nm X Vg^a^ + enX^mVf^j^ ^^(an) fn) X V^^am, (82) 

where X„m is the K x K matrix, [Xnm]kk = (a^nm)^' ^ = [^i; ' ' ' :^n]> and V is the column gradient 
vector. The last two terms in (|82] | are always positive, because of A3 and A2. The first term in (|82] | is 
always negative because t!,j(a„, f„) is increasing according to a„ and V^^an < 0. The second term in (l82l ) 
is always positive because v„(a„,f„) is a decreasing function of f„ and V^^^a^ < 0. Therefore, the social 
utility increases when the negative terms of (|82] | are less than the positive terms. By some rearrangement 
and matrix manipulation, the condition for negative semi-definiteness of W can be obtained. 

Appendix H 

Negative Semi-Definiteness Condition for Affine VI 

1) Consider AVI{B,J\f + n), where S is a closed convex set, M{a) is the monotone map related to B, 
a G B, and n G ;B is the vector with bounded positive values. Let ^{n) be the solution to AVI{B,J\f +n). 
When AA(a) is strongly monotone, <^(n) is monotone (Corollary 2.9.17 in [31]). When ^'(n) is a monotone 
and decreasing function, we have 

(^>(n) -$(0))(Ar(«>(0)) > nee Vn > (83) 

($(0) - $(ii))(AA($(n) + n)>0 neB Vn>0 (84) 

subtracting (1831) from (|84] |. we get 

($(0) - ^>(n))(Ar($(n) - AA($(0)) + n($(0) - $(n)) > (85) 

The above inequality leads to 7V(<^(n)) > A/'(<&(0)). Because of the affinity in AVI, ([85]l is 

A/'f > Vf € (86) 

where f = $(n) — <I>(0) is a negative vector and ( £ B. Since S is a convex and closed region, we have 

r A/'f < 0, Vf G ^ (87) 

which is equivalent to the semi-negative matrix definition. 2) From above, when the strategy of each user 
in the power control game in (|36] l is a decreasing function, A4 is a semi-negative matrix. Therefore, the 
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social utility increases when the strategy of each user is reduced. Obviously, A4 is semi negative when 
—M. is semi-positive, which leads to (l38l) . 

References 

[1] D. Fudenberg and J. Tirole, Game Theory. Cambridge, MA: MIT Press, 1991. 

[2] F. Facchinei and J. S. Pang, Finite-Dimensional Variational Inequalities and Complementarity Problem. Springer- Verlag, 
2003. 

[3] D. P. Palomar and Y. C. Eldar, Convex Optimization in Signal Processing and Communications. Cambridge University 
Press, 2010. 

[4] E. Altman, T. Boulogne, R. El-Azouzi, T. Jimenez, and L. Wynter, "A survey on networking games in telecommunications," 

Computer Operation Research, vol. 33, pp. 286-311, February 2006. 
[5] A. MacKenzie and S. Wicker, "Game theory and the design of self-configuring, adaptive wireless networks," IEEE 

Communications Magazine, vol. 39, no. 39, pp. 126-131, November 2001. 
[6] M. Felegyhazi and J. P. Hubaux, "Game theory in wireless networks: a tutorial," EPFL Technical Report, LCA-REPORT- 

2006-002, February 2006. 

[7] Y. Su and M. van der Schaar, "Structural solutions for additively coupled sum constrained games," IEEE Transactions on 

Information Theory. (Submitted), [Online]. Available:arxiv.org/abs/1005.0880. 
[8] F. Meshkati, A. J. Goldsmith, H. V. Poor, and S. C. Schwartz, "A game-theoretic approach to energy-efficient modulation 

in CDMA networks with delay QoS constraints," IEEE Journal on Selected Areas in Communications, vol. 25, no. 6, pp. 

1069-1078, Aug. 2007. 

[9] R. D. Yates, "A framework for uplink power control in cellular radio systems," IEEE Journal on Selected Areas in 
Communications, vol. 17, no. 7, pp. 1341-1347, Sep. 1995. 
[10] G. Scutari, D. P. Palomar, and S. Barbarossa, "Optimal linear precoding strategies for wideband noncooperative systems 
based on game theory - Part I: Nash equilibria," IEEE Transactions on Signal Processing, vol. 56, no. 3, pp. 1230-1249, 
March 2008. 

[11] , "Optimal linear precoding strategies for wideband noncooperative systems based on game theory - Part II: algorithms," 

IEEE Transactions on Signal Processing, vol. 56, no. 3, pp. 1250-1267, March 2008. 
[12] A. Ben-Tal and A. Nemirovski, "Selected topics in robust convex optimization," Mathematical Programming, vol. 1, no. 1, 

pp. 125-158, July 2007. 

[13] J. Wang, G. Scutari, and D. P. Palomar, "Robust MIMO cognitive radio via game theory," IEEE Transactions on Signal 

Processing, vol. 59, no. 3, pp. 1183 - 1201, March 2011. 
[14] P. Setoodeh and S. Haykin, "Robust transmit power control for cognitive radio," Proceedings of the IEEE, vol. 97, no. 5, 

pp. 915 - 939, May 2009. 

[15] A. B. Gershman and N. D. Sidiropoulos, Space-Time Processing for MIMO Communications. John Wiley and Sons, 
2005. 

[16] R. H. Gohary and T. J. Willink, "Robust IWFA for open-spectrum communications," IEEE Transactions on Signal 

Processing, vol. 57, no. 12, December 2009. 
[17] A. Anandkumar, S. Lambotharan, and J. A. Chambers, "Robust rate-maximization game under bounded channel 

uncertainty," [Online]. Available |http://arxiv.org/abs/101 1 . 1566.pdf | 



26 




.2 .4 .6 .8 1 1 .7 .5 .3 .1 



Mapping Ibr User 1 Mapping tor User 2 

(a) (b) 

Fig. 1. Monotone mapping J^i and T2 for the power control game wlien Y is a P matrix. 

[18] M. Chiang, P. Hande, T. Lan, and C. W. Tan, "Power control in wireless cellular networks," Foundations and Trends in 

Networking, vol. 2, no. 4, pp. 381-533, July 2008. 
[19] G. Zheng, K.-K. Wong, and B. Ottersten, "Robust cognitive beamforming with bounded channel uncertainties," IEEE 

Transactions on Signal Processing, vol. 57, no. 12, pp. 4871 - 4881, December 2009. 
[20] E. A. Gharavol, Y.-C. Liang, and K. Mouthaan, "Robust downlink beamforming in multiuser MISO cognitive radio networks 

with imperfect channel-state information," IEEE Transactions on Vehicidar Technology, vol. 59, no. 6, pp. 2852 - 2860, 

July 2010. 

[21] M. Aghassi and D. Bertsimas, "Robust game theory," Mathematical Programming, pp. 231-273, 2006. 

[22] J.-S. Pang and M. Fukushima, "Quasi-variational inequalities, generalized Nash equilibria, and multi-leader-follower 

games," Operations Research Letters, vol. 36, no. 4, pp. 461^64, July 2008. 
[23] J. Mo and J. Walrand, "Fair end-to-end window-based congestion control," IEEE/ACM Transactions on Networking, vol. 8, 

no. 5, pp. 556-567, October 2000. 
[24] Z.-Q. Luo and J.-S. Pang, "Analysis of iterative waterfiUing algorithm for multiuser power control in digital subscriber 

lines," EURASIP Journal on Applied Signal Processing, 2006. 
[25] G. Scutari, D. P. Palomar, F. Facchinei, and J.-S. Pang, "Convex optimization, game theory, and variational inequality 

theory in multiuser communication systems," IEEE Signal Processing Magazine, vol. 27, no. 3, pp. 35^9, May 2010. 
[26] F. Giannessi, A. Maugeri, and P. M. Pardalos, Eds., Equilibrium Problems: Nonsmooth Optimization and Variational 

Inequality Models (Nonconvex Optimization and Its Applications), 1st ed. Springer, January 2002. 
[27] M. Fukushima and G.-H. Lin, "Smoothing methods for mathematical programs with equilibrium constraints," Proceedings 

of the 12th International Conference on Informatics Research for Development of Knowledge Society Infrastructure, July 

2004, pp. 206- 213. 

[28] C. A. Floudas and P. M. Pardalos, Eds., Encyclopedia of Optimization. Kluwer Academic Publisher, 2001. 

[29] S. Parsaeefard and A. R. Sharafat, "Worst-case robust distributed power allocation in shared unlicensed spectrum." [Online]. 

Available: |http://arxiv.org/abs/1105.2989v3.pdf| 
[30] S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge University Press, 2004. 



Fig. 2. The social utility for the power control game when Y is a P matrix. 




Fig. 4. The impact of channel variations in the robust and the non-robust games. 




Fig. 7. Performance of the opportunistic algorithm in the power control game. 
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Fig. 8. The impact of uncertainty on the total delay of the Jackson network when (a) e = 20% and (b) e = 70% for the 
gradient play and the Jacobi update (7). 
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Fig. 9. Convergence to RNE for the proximal response map when (a) e = 20% and (b) e = 70% . 




Fig. 10. Probability of convergence to RNE when T is a P matrix for different amounts of uncertainty versus (1 — r^^^p) for 
TV = 5 and = 3. 
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TABLE I 

Examples of ACG 



Example 


A; / fc ^fc\ 


J n •^nm 


Vn 


1 
2 


log(l + f ) 


Tk k 1 — fc Tlfc 
/ J rn g .V" , m^n nm^m "t" <-?^7i '^nm 

X^mGA^, mT^n ^nmf^rn ^mn 






TABLE II 
Distributed Algorithm 

Distributed Algorithm for Proximal Response Map 
Inputs for Each User 

T = [1, ■ ■ • ,T]: Users' iterations, e„: Uncertainty region for user n, and < << 1: InteiTupt criteria for all users, 
Initialization For t — 0, 

set a feasible strategy a„(0) and a random value f„{0) for all n £ M, 
Iterative Algorithm 

For f = 1, - • ■ ,r and r oo 

Update the transmit strategy a„(t) = maxa„G^„ *n — |||an(t) — An{t — l)||i for all users. 

Each user transmits the value of an it) to other users, and 

measures the aggregate effects of other users fn(t), 

If ||an(t — 1) — an(i)|| < C End, otherwise t = t continue; 



TABLE III 

Opportunistic Algorithm for Increasing Social Utility 
First Stage: All users play Q to reach the NE with utility v^- 
Second Stage: If aT < T^m^n /^m", Vn e 

Initialization: Let u(0) = E^Li <. < x < 1, '^(O) = 0, and < 5 << 1 
Iterative Algorithm 

Forti = I,-- - ,ri; 

1) Consider uncertainty region £„ = ^{ti), where u){ti) = ti x xfor all n; 

2) a„(ti) = maxa„e^„ - i||a„(ti) - a„(ti - for all user; 

3) User n transmits with an(ti), measures fn(fi), and calculates Un{t — 1); 

4) Users exchange their a„ and u„{ti), 

5) The social utility in ti is calculated via u(ti) = X]!^=i 2'n(ti); 

6) If u{ti) > u{ti — 1), and — — 1)|| > 5: Continue; Otherwise: End. 



